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A SYSTEM AND METHOD FOR DISTRIBUTING PROCESS- 
RELATED INFORMATION IN A MULTIPLE NODE NETWORK 

BACKGROUND OF THE PRESENT INVENTION 

1 . Technical Field of the Present Invention 

[0001] This invention relates generally to information management of 
processes executing on a computer node within a multi-node network, and, more 
particularly, to distribution of process-related information throughout a multi- 
node network. 

2. Description of the Related Art 

[0002] There will now be provided a discussion of various topics to provide 
a proper foundation for understanding the present invention. 
[0003] Typically, distributed systems are comprised of central servers and a 
plurality of nodes. In many instances, servers and nodes are grouped into clusters 
for reasons of communication load distribution, storage allocation and security. 
The processes (e.g., computational tasks) executed on each node of the network 
generate various results, including process-related information that may or may 
not be of interest to other the processes executing in the distributed computing 
environment. In order to synchronize or monitor processes locally within the 
nodes, within a cluster, or across clusters, there is a need to deliver real-time news 
messages between nodes and clusters. The content of these news messages can 
be error messages, file system messages, failover information or any other type of 
process-related information. 

[0004] In order to distribute news messages between nodes, each process 



generates news messages and posts them to other processes located in different 
nodes in the distributed computing environment. Typically, in conventional 
implementations, a process must manage the news message delivery between the 
different nodes. Therefore, the process is kept busy with the management of the 
news message delivery, and thus, the execution time of a computational task 
within the process slows down. Additionally, each process has to manage a 
database for the purpose of saving news messages. 

[0005] Furthermore, nodes in the distributed computing environment can be 
disrupted by unnecessary messages. For example, if a failure occurs during the 
execution of one process, the failed process could generate periodic error 
messages informing the other processes of its failure. These repetitive messages, 
distributed to the processes executing on other the nodes in the distributed 
computing environment, may contain information that is useless to executing 
processes and could possibly disrupt their operation. 

[0006] Gossip protocols can be used to deliver news messages between 
nodes. When transferring a news message, each node randomly chooses a partner 
node with which to communicate. A node simply sends news messages to its 
corresponding partner node and does not wait for an acknowledgment signal from 
the partner node or, if a node has failed, for a recovery action. Hence, there is no 
need for failure detection or specific recovery actions. Nodes achieve fault- 
tolerance by receiving copies of a news message from different nodes. 
[0007] Usually, however, the number of news messages that gossip 
protocols send between partner nodes is fixed. Additionally, a gossip protocol 



I 

does not attain high reliability in a distributed computing environment in which 
links can fail for long periods of time. Hence, for applications that require timely 
delivery, the gossip protocols may not be useful since they are based on eventual, 
rather than timely, delivery of news messages. Gossip protocols also do not 
provide updates regarding changes in the topology of a cluster. 
[0008] It would be an advantageous to implement a system capable of 
providing real-time news services to various nodes in a cluster. It would be 
further advantageous if the system filters duplicative news messages and keeps 
track of historical news messages. 

SUMMARY OF THE PRESENT INVENTION 
[0009] The present invention has been made in view of the above 
circumstances and to overcome the above problems and limitations of the prior 
art. 

[0010] Additional aspects and advantages of the present invention will be 
set forth in part in the description that follows and in part will be obvious from 
the description, or may be learned by practice of the present invention. The 
aspects and advantages of the present invention may be realized and attained by 
means of the instrumentalities and combinations particularly pointed out in the 
appended claims. 

[0011] A first aspect of the present invention provides a network for 
distributing news messages that comprises at least two agents. Each of the agents 
executes on a node in the network, Furthermore, each agent is capable of 
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distributing news messages between the nodes in the network and if capable of 
receiving news messages from other agents executing in the network. The 
network further comprises at least two news loggers. In addition, a first 
communications link is coupled between the agents and a second 
communications link is coupled between the news loggers and the agents. As 
further provided by the first aspect of the present invention, each agent further 
comprises a subscription database, a news service, a distribution unit and a news 
environment. The news environment of an agent comprises an initialization 
thread, a receiving thread, a sending thread and a synchronization thread. When a 
news message is distributed, the validity of the news message is checked, and if 
the news message is valid, it is saved in the subscription database and sent to the 
news loggers. The agent waits for an acknowledgement signal from the news 
loggers, and sends the valid news message to other designated agents. When a 
news message is received, the validity of the incoming news message is checked, 
and a valid news message is sent to the distribution unit. From there, the valid 
news message is distributed to various processes. 

[0012] A second aspect of the present invention provides a method for 
handling news messages using a network comprised of at least two agents. Each 
agent executes on a node within the network and the network further comprises at 
least two news loggers. The method comprises distributing the news messages, 
and receiving the news messages. As further provided by the second aspect of 
the present invention, each agent further comprises a subscription database, a 
news service, a distribution unit and a news environment. The news environment 



of an agent comprises an initialization thread, a receiving thread, a sending thread 
and a synchronization thread. The method further provides that, when a news 
message is distributed, the validity of the news message is checked, and if the 
news message is valid, it is saved in the subscription database and sent to the 
news loggers. As provided by the method, the agent waits for an 
acknowledgement signal from the news loggers, and sends the valid news 
message to other designated agents. The method further provides that, when a 
news message is received, the validity of the incoming news message is checked, 
and a valid news message is sent to the distribution unit. From there, the method 
distributes the valid news message to various processes. 
[0013] A third aspect of the present invention provides a computer software 
product for handling news messages using a network comprised of at least two 
agents. Each agent executes on a node within the network and the network 
further comprises at least two news loggers. The computer software product 
comprises software instructions for enabling the network to perform 
predetermined operations, and a computer readable medium bearing the software 
instructions. The predetermined operations on the computer software product 
enable the network to distribute the news messages, and receive news messages 
as well. As further provided by the third aspect of the present invention, the 
predetermined operations provide each agent with a subscription database, a news 
service, a distribution unit and a news environment. The news environment of an 
agent comprises an initialization thread, a receiving thread, a sending thread and a 
synchronization thread. The predetermined operations further provide that, when 



a news message is distributed, the validity of the news message is checked, and if 
the news message is valid, it is saved in the subscription database and sent to the 
news loggers. As provided by the predetermined operations, the agent waits for 
an acknowledgement signal from the news loggers, and sends the valid news 
message to other designated agents. The predetermined operations further 
provide that, when a news message is received, the validity of the incoming news 
message is checked, and a valid news message is sent to the distribution unit. 
From there, the predetermined operations distribute the valid news message to 
various processes. 

[0014] A fourth aspect of the invention provides a computer system adapted 
for handling news messages. The computer system comprises a network having 
at least two agents. Each agent executes on a node within the network and the 
network further comprises at least two news loggers. The computer system 
further comprises a memory with software instructions adapted to enable the 
computer system to distribute the news messages, and receive news messages as 
well. As further provided by the fourth aspect of the present invention, the 
software instructions are adapted to provide each agent with a subscription 
database, a news service, a distribution unit and a news environment. The news 
environment of an agent comprises an initialization thread, a receiving thread, a 
sending thread and a synchronization thread. The software instructions are 
further adapted to provide that, when a news message is distributed, the validity 
of the news message is checked, and if the news message is valid, it is saved in 
the subscription database and sent to the news loggers. As provided by the 



software instructions, the agent waits for an acknowledgement signal from the 
news loggers, and sends the valid news message to other designated agents. The 
software instructions are further adapted to provide that, when a news message is 
received, the validity of the incoming news message is checked, and a valid news 
message is sent to the distribution unit. From there, the software instructions 
distribute the valid news message to various processes. 
[0015] The above aspects and advantages of the present invention will 
become apparent from the following detailed description and with reference to 
the accompanying drawing figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0016] The accompanying drawings, which are incorporated in and 
constitute a part of this specification, illustrate the present invention and, together 
with the written description, serve to explain the aspects, advantages and 
principles of the present invention. In the drawings, 

FIG. 1 is an exemplary diagram of a typical cluster capable of embodying 
the method of the present invention; 

FIG. 2 is a schematic diagram of an agent; 

FIG. 3 is an exemplary flow chart for posting news message from a 
process; 

FIG. 4 is an exemplary flow chart for receiving a news message by a 
process; 

FIG. 5 is an exemplary diagram of category tree; 



DHTATTKD PFSC RIPTION OF THE PRESENT INVENTION 
[0017] Prior to describing the aspects of the present invention, some details 
concerning the prior art will be provided to facilitate the reader's understanding 
of the present invention and to set forth the meaning of various terms. 
[0018] As used herein, the term "computer system" encompasses the widest 
possible meaning and includes, but is not limited to, standalone processors, 
networked processors, mainframe processors, and processors in a client/server 
relationship. The term "computer system" is to be understood to include at least a 
memory and a processor. In general, the memory will store, at one time or 
another, at least portions of executable program code, and the processor will 
execute one or more of the instructions included in that executable program code. 
[0019] As used herein, the terms "predetermined operations," the term 
"computer system software" and the term "executable code" mean substantially 
the same thing for the purposes of this description. It is not necessary to the 
practice of this invention that the memory and the processor be physically located 
in the same place. That is to say, it is foreseen that the processor and the memory 
might be in different physical pieces of equipment or even in geographically 
distinct locations. 

[0020] As used herein, the terms "media," "medium" or "computer- 
readable media" include, but is not limited to, a diskette, a tape, a compact disc, 
an integrated circuit, a cartridge, a remote transmission via a communications 
circuit, or any other similar medium useable by computers. For example, to 
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distribute computer system software, the supplier might provide a diskette or 
might transmit the instructions for performing predetermined operations in some 
form via satellite transmission, via a direct telephone link, or via the Internet. 
[0021] Although computer system software might be "written on" a 
diskette, "stored in" an integrated circuit, or "carried over" a communications 
circuit, it will be appreciated that, for the purposes of this discussion, the 
computer usable medium will be referred to as "bearing" the instructions for 
performing predetermined operations. Thus, the term "bearing" is intended to 
encompass the above and all equivalent ways in which instructions for 
performing predetermined operations are associated with a computer usable 
medium. 

[0022] Therefore, for the sake of simplicity, the term "program product" is 
hereafter used to refer to a computer-readable medium, as defined above, which 
bears instructions for performing predetermined operations in any form. 
[0023] As used herein, the term "process" is a computational task executing 
on a computer node. The term "news" is information related to a process, 
including, but not limited to, error messages, file system messages, fail-over 
information or any other process-related information. The term "message" is 
information made available by one process to another process. The term "node" 
is a single station within a network and may be a host, a server, a storage device 
or a computer. The term "cluster" is a group of nodes within a network 
computer. The term "subscriber" may be a process executing on a node, a node 
within a cluster, or a cluster within a network, and that has subscribed for some or 
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all of the news. 

[0024] A detailed description of the aspects of the present invention will 
now be given referring to the accompanying drawings. 

[0025] The present invention provides for handling news messages. News 
messages are used for synchronization between processes executing within a 
node, synchronization between processes executing within a cluster, and 
synchronization between processes executing across clusters. In addition, news 
messages are used for failover message, error messages and the likes. The 
present invention manages news messages by using a news agent. A news agent 
manages news messages by distributing news messages to subscribing processes, 
as well as executing queries on behalf of subscribers. 

[0026] Referring to FIG. 1 , an exemplary computer cluster 100 comprising 
N nodes 110-1 through 110-N, is shown, wherein N represents the number of 
nodes in the exemplary computer cluster 100. Each node 110 contains a news 
agent 120, where node 110-1, 110-2, 110-3, 110-4, 110-N contain news agents 
120-1, 120-2, 120-3, 120-4, 120-N, respectively. Cluster 100 further comprises at 
least two news loggers 130-1, 130-2. The news loggers 130-1, 130-2 provide 
redundancy to ensure reliable messaging between the nodes 1 10-1, 1 10-2, 1 10-3, 
1 10-4, 1 10-N in case of certain system failures. The news logger 130 stores all of 
the news messages transferred between nodes 110-1, 110-2, 110-3, 110-4, 110-N 
for the purpose of synchronization between the news agents 120-1, 120-2, 120-3, 
120-4, 120-N. The news loggers 130 and the new agents 120 communicate via a 
common communication link 140. The common communication link 140 can 
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comprise, but is not limited to, a local area network (LAN), a wide area network 
(WAN), an Infiniband network or a peripheral component interface (PCI) 
network, and other. 

[0027] Communication between the news loggers 1 30 and the news agents 
120 is established using unicast protocols. A unicast protocol is used for sending 
packets to a single node within a network. The news agents 120-1, 120-2, 120-3, 
120-4, 120-N communicate between themselves by using multicast protocols. A 
multicast protocol is used for sending packets addressed to multiple nodes. 
[0028] Messages are distributed from a specific news agent only to other 
news agents belonging to its group. Each group is defined using the standard 
Internet Group Manage Protocol (IGMP). IGMP allows news message 
broadcasters to send news messages to a large number of nodes, while traffic is 
sent only to a Group Destination Address (GDA). The new agents 120 use IGMP 
to register themselves as receivers of certain multicast groups. The multicast 
traffic influences only those receivers that are registered to a specific GDA. A 
person skilled in the art could easily implement such a system by using other 
protocols for distributing information via network. 

[0029] Referring to FIG. 2, an exemplary embodiment of a news agent 1 20 
is illustrated. The news agent 120 is comprised of a news service 210, a 
subscription database 220, a distribution unit 230 and a news environment 240. 
The news environment 240 executes a variety of threads for the purpose of 
interfacing with other news agents. The threads include, but not limited to, a an 
initialization thread 250-1, a receiving thread 250-2, a sending thread 250-3 and a 
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synchronizing thread 250-41. The news service 210 is the core of the news agent 
120, and manages all of the activities for subscribers, including sending news 
messages and querying the database. A subscribing process and the news service 
210 communicate using a First In First Out (FIFO) interface channel 260. 
[0030] In the FIFO channel 260, a process registers in order to receive news 
messages, and news messages are sent to registered processes according to the 
order of message arrival. Initially, the news service 210 creates the subscription 
database 220 by allocating memory. The allocated memory can be cache 
memory, RAM memory, flash memory, disk, hard disk, or any other read-write 
electronic memory used for temporary storage of data. Using the synchronization 
thread 250-4, the news service 210 monitors neighboring news agents. The news 
agent neighbors are defined by using standard protocols for multicasting groups 
(i.e., IGMP, Internet group management protocol) as explained above. The news 
service 210 also monitors subscriber processes using the FIFO channel 260. 
Only registered processes may send or received messages through the FIFO 
channel 260. 

[0031] The news agent 120 provides news services to processes executing 
within a node, to processes executing within a cluster, and to processes executing 
across clusters. Using the news agent 120, a process may subscribe to a news 
category, query the subscriber database 220, or post news messages for possible 
use by |ther processes. A process that is interested in specific information (to be 
provided in a form of a news message) contacts the news services 210 via the 
FIFO channel 260, and transmits a subscription command. The interested process 
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also passes its process-identification, which is unique process identification 
within the FIFO channel 260. The subscription command also updates the 
subscription database 220, if it is indexed by category and subcategories, such 
that a category/subcategory in the subscription database 220 points to a 
subscriber. Each subscriber chooses categories/subcategories from a category 
tree namespace according to the desired information. A process chooses 
categories automatically according to its tasks' requirements. For example, fail- 
over news messages will be in a category responsible for handling fail-over 
messages. 

[0032] Referring to FIG. 3 , an exemplary process flow for the posting news 
messages is illustrated. At S3 10, a process informs the news service 210 that 
there is a news message to distribute. The process passes a post command 
through the FIFO channel 260 to the news service 210. A news message 
comprises the following fields: news category, node identification, process 
identification and data. Generally, the node identification field is a unique 
number, or sequence of alphanumeric characters, given to each node. Similarly, 
the process identification field is a unique number, or sequence of alphanumeric 
characters, given to each process executed within a node. 

[0033] At S320, the news service 210 receives news message and performs 
validity checks on the received news message. For example, these checks could 
verify if a news message arrived from a known process, if the news message 
corresponded to a valid category, or if the news message is a duplicative of a 
previously received news message. At S325, the news service 210 rejects all 

-13- 



invalid messages and does not distribute them. 

[0034] At S330, only valid messages are saved in the subscription database 
220. If subscription database 220 is full, then a message will be dropped out of 
the subscription database 220. Dropping algorithms can comprise, but are not 
limited to, random, first in first out, or least recently used (LRU). Alternatively, a 
message may be deleted using a time-to-live (TTL) approach, where each 
messages includes a time counter indicating the length of time a message is 
allowed to survive before being discarded. 

[0035] At S340, the news service 210, using the synchronizing thread 250- 
4, sends a message by means of unicast protocols to the news loggers 130. At 
S350, the news service waits for an acknowledgement signal from the news 
logger 130. At S360, if the news logger 130 returns an acknowledgement signal, 
then the news service 210 distributes the message to all of its neighbors as 
multicast messages, using sending thread 250-3. The news message is distributed 
via the common communications link 140, and every node with a news agent that 
is subscribed to the news item will pickup the message. If news loggers 130 do 
not return an acknowledgement signal, at S370, then a failure trap sub-procedure 
is executed. This failure trap sub-procedure attempts to synchronize with news 
loggers 130. In case the news loggers 130 do not respond, then the process of 
distributing a message from the news agent 120 is restarted. It should be noted 
that when restarting a single the news agent 120, the other the news agents are not 
infected. 

[0036] Referring to FIG. 4, an exemplary process flow of receiving a 
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message by news agent 120 is illustrated. A S410, a node in a cluster receives a 
news message and passes it to its corresponding news agent. For example, if 
node 110-1 received a news message, it would be passed to its news agent 120- 1 . 
The news agent 120-1 picks up messages using the receiving thread 250-2. At 
S420, the receiving thread 250-2 parses the message, and extracts the news 
message from it. At S430, the news services 210 performs validity checks on the 
incoming news message. For example, these checks could verify if a message 
arrived from a known source, whether the message corresponds to a valid 
category, or if that message is a duplicative of a previously received message. 
[0037] At S440, invalid messages are rej ected by the news service 210 and 
are ignored. Valid news messages are saved in the subscription database 220 and 
passed to the distribution unit 230. At S450, the distribution unit 230 searches for 
subscribers according to news message category in the subscription database 220. 
At S460, for each subscriber that is found, the distributor unit 230 pushes the 
news message to the subscriber using the FIFO channel 260. 
[0038] Additionally, a process has the capability to check for past news 
messages using queries. A process will command the news service 210 to 
perform queries of the subscription database 220 through the FIFO channel 260. 
For example, a query may be based on a category, a keyword, node identification 
and/or process identification. The news service 210 searches the subscription 
database 220 for news messages matching the query. All matching results are 
sent to a process via FIFO channel 260. The matching results can include 
messages from sub-categories related to the requested category. 
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[0039] Referring to FIG. 5 , an exemplary implementation of a subscription 
database 200 as category tree 500 is illustrated. The subscription database 220 is 
arranged in a category tree structure 500, where each node in the tree represents a 
category. A category includes an array of pointers, which point to subcategories, 
or to a list of subscribers and a list of messages. In FIG. 5, there are shown 
examples of three main categories. The hardware category 510 indicates 
messages relating to hardware, and further points to a subcategory 540 called 
"HW_COMP_DOWN" and a sub-category 545 called "HWJX>MP_UF\ which 
correspond to hardware pieces that are non-functional and functional, 
respectively. Subcategory 545 points to a list of subscribers 560 and a list of 
news messages 565. Subscriber list 560 includes N subscribers who have 
requested information relating to the subcategory 540 "HW_COMP_DOWN". 
[0040] Under this subcategory 545 , there are N news messages arranged in 
message list 565. News messages in the message list 565 may be news messages 
indicating hardware status, hardware utilization, etc. Registered subscribers from 
the subscriber list 560 will receive all messages from the message list 565. The 
category 520 does not have subcategories, and handles a subscriber list 550 and a 
message list 555 in the manner described above. The category 530 is an example 
of an empty category; hence, it is not pointing to any subcategories, subscribers 
or messages. 

[0041] In another exemplary embodiment of the present invention, a 
computer software product for handling news messages using a network 
comprised of at least two agents is provided. Each agent executes on a node 
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within the network and the network further comprises at least two news loggers. 
The computer software product comprises software instructions for enabling the 
network to perform predetermined operations, and a computer readable medium 
bearing the software instructions. The predetermined operations on the computer 
software product enable the network to distribute the news messages, and receive 
news messages as well. 

[0042] As described above, the news messages comprise messages 
generated by a process executing on a node. The predetermined operations borne 
on the computer program product provide each agent with a subscription 
database, a news service, a distribution unit and a news environment. In the 
exemplary embodiment, the subscription database is organized as a category tree. 
As illustrated in FIG. 5, each category in the category tree can comprise one or 
more subcategories. Typically, a category in the category tree comprises a 
process list and a message list. 

[0043] The predetermined operations further provide that, when a news 
message is distributed, the validity of the news message is checked, and if the 
news message is valid, it is saved in the subscription database and sent to the 
news loggers. In order to store a fresh news message, the predetermined 
operations drop older news messages from the subscription database if the 
database is full. As provided by the predetermined operations, the agent waits for 
an acknowledgement signal from the news loggers, and sends the valid news 
message to other designated agents when it receives the acknowledgement signal 
from the news loggers. When a news message is received, predetermined 
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operations check the validity of the incoming news message, and a valid news 
message is sent to the distribution unit. From there, the predetermined operations 
distribute the valid news message to various processes. 

[0044] For an agent, the predetermined operations provide a news 
environment comprised of an initialization thread, a receiving thread, a sending 
thread and a synchronization thread. The synchronizing thread is used for 
sending valid news messages to the news loggers, since the news loggers are used 
for synchronization between agents. The sending thread is used for sending the 
valid news messages to designated agents. The receiving thread is used for 
receiving news messages from other agents. The initializing thread is used to 
initialize an agent, which includes creating the subscription database, and 
registering at least one process for news services. 

[0045] In another exemplary embodiment of the present invention, a 
computer system adapted for handling news messages is provided. The computer 
system comprises a network having at least two agents. Each agent executes on a 
node within the network and the network further comprises at least two news 
loggers. The computer system further comprises a memory with software 
instructions adapted to enable the computer system to distribute the news 
messages, and receive news messages as well. 

[0046] As described above, the news messages comprise messages 
generated by a process executing on a node. The software instructions are 
adapted so that the computer system provides each agent with a subscription 
database, a news service, a distribution unit and a news environment. In the 
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exemplary embodiment, the subscription database is organized as a category tree. 
As illustrated in FIG. 5, each category in the category tree can comprise one or 
more subcategories. A category in the category tree comprises a process list and 
a message list, as well as other items that may be of interest to the various 
processes that receive the news messages. 

[0047] The software instructions are further adapted such that the computer 
system provides that, when a news message is distributed, the validity of the 
news message is checked, and if the news message is valid, it is saved in the 
subscription database and sent to the news loggers. In order to store a fresh news 
message, the software instructions are adapted to drop older news messages from 
the subscription database if the subscription database is full. As provided by the 
software instructions, the agent waits for an acknowledgement signal from the 
news loggers, and sends the valid news message to other designated agents when 

it receives the acknowledgement signal from the news loggers. When a news 

i 

message is received, the software instructions are adapted to check the validity of 

I 

the incoming news message, and a valid news message is sent to the distribution 
unit. From there, the software instructions are adapted so that the computer 
system distributes the valid news message to various processes. 
[0048] For an agent, the software operations are further adapted so that the 
computer system provides a news environment comprised of an initialization 
thread, a receiving thread, a sending thread and a synchronization thread. The 
synchronizing thread is used for sending valid news messages to the news 
loggers, since the news loggers are used for synchronization between agents. The 
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sending thread is used for sending the valid news messages to designated agents. 
The receiving thread is used for receiving news messages from other agents. The 
initializing thread is used to initialize an agent, which includes creating the 
subscription database, and registering at least one process for news services. 
[0049] The foregoing description of the aspects of the present invention has 
been presented for purposes of illustration and description. It is not intended to 
be exhaustive or to limit the present invention to the precise form disclosed, and 
modifications and variations are possible in light of the above teachings or may 
be acquired from practice of the present invention. The principles of the present 
invention and its practical application were described in order to explain the to 
enable one skilled in the art to utilize the present invention in various 
embodiments and with various modifications as are suited to the particular use 
contemplated. 

[0050] Thus, while only certain aspects of the present invention have been 
specifically described herein, it will be apparent that numerous modifications may 
be made thereto without departing from the spirit and scope of the present 
invention. Further, acronyms are used merely to enhance the readability of the 
specification and claims. It should be noted that these acronyms are not intended 
to lessen the generality of the terms used and they should not be construed to 
restrict the scope of the claims to the embodiments described therein. 
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